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6.2.6 Solved Problems 

Problem 1 

Your friend tells you that he had four job interviews last week. He says that based on how the interviews 
went, he thinks he has a 20% chance of receiving an offer from each of the companies he interviewed 
with. Nevertheless, since he interviewed with four companies, he is 90% sure that he will receive at 
least one offer. Is he right? 

• Solution 

o Let Aj be the event that your friend receives an offer from the 7 th company, i=l,2,3,4. Then, 
by the union bound: 

%ltiA)<EAA) 

= 0 . 2 + 0 . 2 + 0 . 2 + 0.2 
= 0.8 

Thus the probability of receiving at least one offer is less than or equal to 80%. 


Problem 2 

An isolated edge in a network is an edge that connects two nodes in the network such that neither of the 
two nodes is connected to any other nodes in the network. Let C n be the event that a graph randomly 
generated according to G{n , p) model has at least one isolated edge. 

a. Show that 

P(°n) < (”)p(l - p) 2( "- 2) 

,1 , ln(n) 

b. Show that, for any constant 0 > y, ifp = p n = 0—— then 

lim P(C n ) = 0. 

n— >oo 

• Solution 

o There are Q) possible edges in the graph. Let E r be the event that the 7th edge is an 
isolated edge, then 

P(Ei) =p(l-p) 2 <"+ 
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where p in the above equation is the probability that the Zth edge is present and 
(1 -P) 2(n “ is the probability that no other nodes are connected to this edge. By the 
union bound, we have 

P(C n ) = P([)Ei) 

< Ei P(Ei) 

= (”)p(l-p) 2 <“- 2 ), 

which is the desired result. Now, let p = 6^^, where b > j. 

Here, it is convenient to use the following inequality: 

1 — x < e~ x , for all xGl. 

You can prove it by differentiating /(at) = e~ x + at — 1, and showing that the minimum 
occurs at at = 0. 

Now, we can write 

p(c n ) = (j)p(i -p) 2 <"- 2) 

_ n ( n ~ 1 ) 6Inn ^ p^2(n—21 

< ( n ^ 1 ) b e - 2 p(n- 2 ) ( us i n g 1 — at < e - *) 

Thus, 

lim n ^oo P(Cn) < lim n _^ 00 — 6e~ 2 ~^~( n ~ 2 ) 

= lim n ^ 00 ^-^-bn~ 2b 
= lim n ^ 00 (n 1_2& ) 

= 0 (since & > 


Problem 3 

Let X ~ Exponential(X). Using Markov's inequality find an upper bound for P[X > a). 
Compare the upper bound with the actual value of P(X > a). 

• Solution 

O IfX~ Exponential(X), then EX = y, using Markov's inequality 


https://www.probabilitycourse.com/chapter6/6_2_6_solved6_2.php 


2/7 



9 / 17/2018 


Solved Problems 


P(X >a)< 


EX 


a X a 

The actual value of P(X > a ) is e ~^ a , and we always have > e _ ^“. 


Problem 4 

Let X ~ Exponential(X). Using Chebyshev's inequality find an upper bound for 

P(|X-£X| >b). 

• Solution 


a. We have EX = \ and Var X = —. Using Chebyshev's inequality, we have 


P(\X-EX\ >b)< 


Var(X) 


_ 1 


A 2 b 2 


Problem 5 

Let X ~ Exponential(X). Using Chernoff bounds find an upper bound for P(X > a), where 
a > EX. Compare the upper bound with the actual value of P (X > a). 

• Solution 


o lfX~ Exponential A), then 


Mx(s ) = —-, for s < X. 


X — s 


Using Chernoff bounds, we have 


P(X > a) < min [e" sa M x (s) 


= mm 

s>0 


A 


A — s 


If f(s) = e to find min s>0 f(s) we write 


d 


u-/( s ) = 0. 

ds 
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Therefore, 

8* =X~~. 

a 

Note since a > EX = then A — — >0. Thus, 

A a 

P(X> a) < e~ s * a —= aAe 1_Aa . 
v ~ ~ A -s* 

The real value of P ( X > a) is e _Aa and we have e _Aa < aAe 1_Aa , or equivalently, 
a\e > 1, which is true since a > -r-. 


Problem 6 

Let X and Y be two random variables with EX = 1, V ar( X) = 4, and 
EY = 2 ,Var(Y) = 1 . Find the maximum possible value for E [XY]. 

• Solution 


o Using p(X,Y) < 1 and p(X, Y) = , we conclude 

- EXEY 

-< 1. 

cr x&y 

Thus 


EXY < <jx<jy + EXEY 
=2x1+2x1 
= 4. 

In fact, we can achieve EXY = 4, if we choose Y" = aX + 6. 

y = aX+& => 

Solving for a and 6, we obtain 

1 

“ 2 ’ 

Note that if you use the Cauchy-Schwarz inequality directly, you obtain: 

\EXY\ 2 < EX 2 -EY 2 


2 — a b 
1 = (a 2 )( 4) 
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= 5x5. 


Thus 


EXY < 5. 

But EXY = 5 cannot be achieved because equality in the Cauchy-Schwarz is obtained 
only when Y = OlX. But here this is not possible. 


Problem 7 


(Holder's Inequality) Prove 

E[\XY\] < E[\X\ P ]> E[\Y\ q ] % 

where 1 < p,q < OC and — + — = 1 . Note that, for p = q = 4, Holder's ineqality becomes the 
Cauchy-Schwarz inequality. Hint: You can use Young's inequality [4] which states that for nonnegative 
real numbers a and f3 and integers p and q such that 1 < p,q < OO and ~ Y = 1 , we have 


with equality only if a? = f3 q . 


a (3 < 



p q 


• Solution 


o Using Young's inequality, we conclude that for random variables U and V we have 


, , EU P EV q 

E UV\ < -+- 

p q 

Choose U = -- —and V = -- —. We obtain 


(. E\X\ p )p 


(. E\Y\ q ) i 


E\XY\ 


i 


E\X\ P E\Y\ q 
1 ^ + 


(E\X\ P ) p (E\Y\ q ) i P E \ X \ qE\Y\ 

= 1 


v q 


Problem 8 

Show that if h : M i—> M is convex and non-decreasing, and g : M i—> M is convex, then h(g(x)) is 
a convex function. 

• Solution 


https://www.probabilitycourse.com/chapter6/6_2_6_solved6_2.php 


5/7 



9 / 17/2018 


Solved Problems 


o Since g is convex, we have 

g(ocx + (1 — <y)y) < ocg{x) + (1 — a)g(y), for all a E [0,1]. 

Therefore, we have 

h(g(ax + (1 — Oi)y )) < h(ag(x ) + (1 — a)g(y)) (h is non-decreasing) 

< ah(g(x )) + (1 — <y)h(g(y)) (h is convex). 


Problem 9 

Let X be a positive random variable with EX = 10. What can you say about the following 
quantities? 



c. E[\ny/X] 


• Solution 


a. 


a(x) = 1 

S»= (!+»)> 


x+1 ’ 

2 


Thus g is convex on (0, oo) 


E 


x+i 


> —i— 

— 1+£W 

_ 1 
1+10 

= J_ 

11 • 


> 0, for x > 0. 


(Jensen’s inequality) 


b. If we let h{x) = e x , g{x) = then h is convex and non-decreasing and g is 

i 

convex thus by problem 8, e x + 1 is a convex function, thus 


E 


■ i 

e i+x 


i 

> e l + EX (by Jensen’s inequality) 


= en . 


c. If^(*) = In y/x = |-lnat, then^(*) = ^ forte > 0 and 
g ( X ) = — 2*2"' Thus g is concave on (0, oo). We conclude 

E [in y/~X] = E [ylnX] 

< |-ln EX (by Jensen’s inequality) 
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= |-lnl0. 


<— previous 
next —> 
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